AD-A221  479 


AR-005-624 


i'iLC  uurJ 


ARL-SYS-TM- 125 


~hx 


DEPARTMENT  OF  DEFENCE 

DEFENCE  SCIENCE  AND  TECHNOLOGY  ORGANISATION 
AERONAUTICAL  RESEARCH  LABORATORY 

MELBOURNE,  VICTORS* 


Aircraft  Systems  Technical  Memorandum  125 


A  WORKED  EXAMPLE  OF  JOB  SIMULATION  USING  Micro  SAINT  (U) 


by 


CM.  Ford 
J.G.  Manton 
and 

P.K.  Hughes 


DTIC 

Fl.ECTE  I' 
MAY  1 4 1990 1 

<*E 


Approved  for  public  release. 


(C)  COMMONWEALTH  OF  AUSTRALIA  1990 


^  14 


AUGUST  1989 


*  MJWOWSCO  ■ TO  ,***» 

I  d^seouis  w®  ' 


This  work  is  copyright.  Apart  from  any  fair  dealing  for  the  purpose  of  study, 
research,  criticism  or  review,  as  permitted  under  the  Copyright  Act,  no  part 
may  he  reproduced  by  any  process  without  written  permission.  Copyright  is  the 
responsibility  of  the  Director  Publishing  and  Marketing,  AGPS.  Inquiries  should 
be  directed  to  the  Manager,  AGPS  Press,  Australian  Government  Publishing 
Service,  GPO  Box  84,  CANBERRA  ACT  2601. 


AR-005-624 


DEPARTMENT  OF  DEFENCE 
DEFENCE  SCIENCE  AND  TECHNOLOGY  ORGANISATION 
AERONAUTICAL  RESEARCH  LABORATORY 


Aircraft  Systems  Technical  Memorandum  125 


A  WORKED  EXAMPLE  OF  JOB  SIMULATION  USING  Micro  SAINT 


by 


CM.  Ford 
J.G.  Manton 
and 

P.K.  Hughes 


SUMMARY 

Micro  SAINT  is  a  computer  based  simulatiou  environment  tailored  to  exercising  models 
of  human  operators  performing  job  activi  ties.  Models  of  human  activity  systems  can  be 
defined  and  exercised  to  determine  the  impact  of  various  job  design  parameters  on 
system  performance.  In  this  worked  example,  the  activities  of  a  ship’s  crew  and  the 
aircrew  of  an  anti-submarine  warfare  helicopter  are  modelled  during  the  period  of 
preparation  for  a  sortie.  This  model  was  used  to  gain  experience  with  the 
Micro  SAINT  package  and  to  explore  some  of  the  features  of  the  package. 
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y  I.  ini roduelion 

A  great  deal  of  interest  in  aviation  human  factors  is  concerned  with  the  cognitive,  sensory  and 
physical  workload  experienced  by  aircrew.  This  interest  is  partly  due  to  recent  changes  in 
aircraft  systems  and  cockpit  display  technology  in  which  single  purpose  instruments  are 
being  replaced  by  multifunction  and  dedicated  electronic  displays  that  present  integrated  and 
(supposedly)  simplified  graphical  information  (Hart,  1988).  With  the  rapid  expansion  of 
aircraft  system  capability  due  to  advanced  technologies,  it  is  important  that  aircrew  can  fully 
utilize  the  functions  provided.  Inability  to  do  so  because  of  excessive  workload  demands  will 
limit  the  operational  performance  of  the  aircraft. 

The  most  frequently  used  aietitods  of  investiggtiiig  operator  workload  are  based  on  empirical 
studies  and  therefore  depend  on  the  availability  of  human  operators  and  a  completed  system, 
or  at  least  a  prototype  of  the  system  (Hills  et  al.,  1 987),  On  the  other  hand,  analytic  methods 
are  used  to  predict  workload  at  an  earlier  stage  of  system  design  without  requiring  operators 
or  systems.  SAINT  (Systems  Analysis  of  an  Integrated  Network  of  Tasks),  an  example  of  an 
analytic  technique,  is  a  workload  simulation  computer  program  which  attempts  to  predict 
human  performance  using  a  task  network  modelling  framework.  Operator  or  system 
performance  is  represented  in  a  task  network  by  attributes  of  tasks  such  as  the  mean, 
standard  deviation  and  shape  of  die  distribution  of  task  completion  times.  Relationships 
between  tasks  ate  represented  by  branching  and  looping  logic  that  determines  the  sequence,  of 
tasks  in  the  network.  The  probabilistic  nature  of  the  branching  logic  and  the  variable 
completion  times  of  individual  tasks  means  that  repeated  execution  of  the  model  will  generate 
many  different  paths  through  die  network  and  consequently  a  range  of  completion  times  for 
the  whole  networic.  Exercising  the  model  cm  therefore  indicate  how  a  system  with  a  human 
operator  might  perform. 

V 

SAINT  was  developed  at  the  Armstrong  Aerospace  Medical  Research  Laboratory  of  the 
USAP  for  use  in  human  factors  studies  with  P-GERT  networks  and  Stegal  and  Wolf 
man-machine  models  (Chubb,  1981 ).  SAINT  is  run  on  a  mainframe  computer  and  requires 
some  familiarity  with  Fortran  programming  (Langhery  and  Drews,  1985).  Micro  SAINT  was 
developed  for  IBM  personal  computers  in  order  to  overcome  some  of  the  cumbersome 
language  problems  encountered  with  .SAINT,  The  personal  computer  version  incorporates  a 
more  easily  leanrt  interface  but  there  is  some  ltws  of  flexibility  and  power  compared  with  the 
mainframe  version.  Micro  SAINT  has  an  interactive  user  environment  for  specifying  and 
developing  task  network  models  and  therefore  permits  development  of  task  networks  in  a 
relatively  straightforward  manner. 

The  initial  use  of  the  Micro  SAINT  modelling  environment  was  to  predict  die  time  aircrew 
take  to  complete  sequences  of  tasks  in  tile  Royal  Australian  Navy's  Seahawk  helicopter.  The 
Seahawk  helicopter  is  due  to  come  into  service  in  1990  but  will  initially  go  through  an 
operational  test  and  evaluation  (OT  A  E)  assessment.  The  predictions  of  the  model  will  be 
compared  with  performance  of  aircrew  during  the  OT  &  E  phase.  If  the  model  can  be 
validated  then  it  will  become  a  powerful  tool  for  assessing  changes  in  aircrew  workload 
when  additional  weapon  and  sensor  systems  are  proposed. 

The  first  stage  of  the  model  building  process  is  task  analysis  in  which  a  particular  job  is 
described  in  terms  of  its  constituent  elements.  For  demonstration  purposes  we  have  used  an 
analysis  performed  by  the  Naval  Work  Study  Team  who  interviewed  Fieet  Air  Amt 
personnel  with  experience  of  S-2  Tracker  operations  (the  S-2  Tracker  and  die  Seahawk  have 
many  functional  characteristics  in  common).  The  interviewers  examined  the  procedures  that 
might  be  followed  by  the  crcrv  of  a  Seahawk  helicopter  in  preparing  for  an  anti-submarine 
warfare  (ASW)  sortie  flown  from  a  ship.  This  task  analysis  identified  the  tasks  that  each 
member  of  the  crew  would  perform,  the  estimated  time  to  complete  each  task  and  whether 
aircrew  would  interact  with  another  crew  member  to  achieve  a  particular  task  goal.  From  this 


tstformatiofj  a  network  diagram  was  developed.  The  tretwork  diagram  ’Tescsaahawk"  in 
Figure  '  gives  an  overview  of  (he  tasks  performed  by  each  member  of  tire  aircrew  and  ship's 
personnel. 

Tiiis  paper  describes  tins  requirements  for  constructing  a  network  and  generating  valid  results 
frcan  a  task  network  simoiaiion. 

2.  Building  a  Task  Network  Model 

There  are  two  aspects  to  building  a  task  network:  firstly  designing  the  network.,  and 
secondly,  entering  the  network  details  into  the  Micro  SAINT  application  (Laughery,  1985). 
The  task  analysis  process  is  used  to  identify  all  the  tasks  to  be  performed  by  the  operators, 
the  order  in  which  they  arc  performed  and  any  interactions  between  tasks. 

In  the  Micro  SAINT  application  a  network  represents  tire  compilation  of  till  tasks  performed 
and  includes  tlietr  order  and  any  interactions  between  tasks,  whereas  a  task  is  a  description  of 
an  event  or  activity.  Networks  and  tasks  can  represent  the  activity  of  a  machine  or  system,  or 
(he  activities  of  a  human  operator.  Within  tlie  Micro  SAINT  network  structure  each  task  is 
represented  by  a  node.  Each  node  consists  of  attributes  such  as  identification  number,  name, 
time  to  compietc,  the  names  of  following  tasks  and  any  user  defined  relationships  to  describe 
the  effect  of  task:  completion  on  tire  system. 

The  operator  interface  to  Micro  SAINT  is  a  series  of  menus  and  ail  stages  of  the  program 
appear  in  tire  main  menu,  lire  interactive  simulation  environment  is  presented  in  four  discrete 
sub-programs:  model  development,  mode!  execution,  analysis  of  results  and  utilities. 

The  model  development  sub-program  allows  tire  model  developer  to  enter  details  of  all 
tasks  and  the  conditions  tinder  which  the  model  is  required  to  operate.  The  modify  task,  mem 
is  used  to  enter  information  such  as  task  number,  name,  mean  completion  time  and  standard 
deviation,  any  following  task(s)  and  any  user  defined  relationships.  Tlie  user  defined 
relationship  attributes  include  the  lime  distribution  type  and  task  release  conditions.  The  rime 
distribution  type  specifies  the  characteristics  of  the  statistical  distribution  as  either  normal, 
exponential,  gamma  or  rectangular  and  also  tire  distribution’s  mean  and  standard  deviation. 
The  task  release  condition  fields  specifies  tire  conditions  under  which  a  task  will  be  ’released' 
(release  in  Micro  SAINT  terminology  is  a  condition  dial  allows  a  task  in  die  network  to  start). 
Tlie  decision  type  field  specifies  the  following  task(s)  or  neiwork(s)  and  their  relative 
probabilities  of  occurrence.  The  five  decision  type  alternatives  are: 

(a)  last  task,  meaning  no  more  tasks  or  networks  will  execute  as  a  result  of  the 
completion  of  this  task 

(b)  single  choice,  where  there  is  only  one  possible  following  task  or  network 

(c)  probabilistic,  where  one  of  several  alternative  tasks  or  networks  will  follow.  The 
probability  of  each  task  occurring  is  determined  by  a  probability  expression 

(d)  tactical,  where  one  of  several  alternative  tasks  or  networks  will  follow.  The 
possible  occurrence  of  each  task  is  detennined  by  an  expression  consisting  of 
numeric  constants,  variables  and  mathematical  or  logical  operators  which 
calculates  to  a  single  value.  The  expression  that  calculates  to  the  highest  value 
indicates  die  next  task  or  network  to  execute 

(e)  multiple,  wltere  there  are  several  simultaneous  tasks  or  networks  to  follow. 

There  are  other  features  of  model  development  which  permit  manipulation  of  the  network  to 
satisfy  five  modelling  problem.  The  job  queue  field  facility  specifies  which  job  executes  next 
when  tliere  are  multiple  jobs  travelling  through  a  network.  This  facility  creates  a  job  queue 
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and  tasks  wait  to  fee  released  through  tit?,  network  until  other  jobs  have  beat  completed-  'Hie 
variable  catalog  (sic)  is  a  table  where  aii  Che  variables  relevant  to  tbs  modelling  problem  are 
specified.  Variables  can  represent  system  or  control  attributes.  There  is  also  a  facility  to 
generate  arrays  if  the  same  variable  name  is  used  to  index  an  ordered  set  of  variables.  The 
Junction  library  permits  development  of  functions  which  may  be  needed  several  times 
during  a  model  The  continuous  variable  feature  allows  changes  of  variables  hi  the  model  at 
regularly  scheduled  intervals  and  may  peri  nit  modelling  of  factors  such  as  fatigue  or  stress. 
The  simulation  scenario  feature  can  be  used  to  specify  a  change  to  a  variable  in  die  model  at 
specified  clock  times.  The  snapshots  facility  extracts  information  about  model  variables  at 
defined  rimes  during  model  execution.  Snapshots  can  be  created  at  specified  tunes  on  the 
clock,  at  particular  job  queues  or  at  specified  tasks. 

Model  execution  is  the  part  of  the  program  that  permits  the  model  to  run.  The  display  made 
menu  has  tire  following  five  alternatives:  reticent,  medium,  verbose,  event  queue  and  debug. 
The  debug  mode  is  used  during  the  initial  stages  of  model  development  and  execution 
because  it  provides  the  greatest  amount  of  information  about  the  model's  structure  and 
indicates  my  errors  that  occur  during  execution  of  the  model.  Reticent  may  be  used  after  the 
model  has  been  debugged  and  is  being  run  for  data  collection.  Hie  other  three  modes  provide 
different  amounts  of  information  which  may  be  useful  if  the  effect  of  various  variables,  job 
queues  or  simulation  scenarios  is  required.  The  model  execution  menu  has  a  facility  to  turn 
the  snapshots  or  execution  trace  on  or  off  depending  on  whether  tire  mode!  is  executed  to 
collect  data  or  not.  A  different  random  number  seed  is  generated  by  Micro  SAINT  for  each 
execution  of  the  model  and  is  used  to  calculate  task  completion  rimes  and  probabilistic  paths 
through  rise  network.  When  standard  deviation  equals  zero,  the  model  and  all  individual 
tasks  execute  for  their  average  time  compared  to  their  various  execution  tunes  if  rite  standard 
deviations  of  task  completion  times  are  non-zero.  The  variables  to  display  opt  ion  permits  the 
values  of  the  selected  variables  to  be  displayed  on  the  screen  during  model  execution.  The 
values  of  variables  can  be  reset  by  entering  expressions  in  rite  manipulate  variables  field.  The 
number  of  times  to  execute  defines  how  many  times  the  model  iterates.  Siegai  and  Wolf 
(1969)  suggested  that  between  100  and  200  tuns  of  a  model  will  generate  stable  results. 

The  analysis  of  results  section  of  the  program  displays  the  results  from  any  model 
execution.  After  each  iteration  of  tfie  model,  data  are  stored  in  four  different  results  files.  The 
error  files  (.ERR)  stores  rise  list  of  error  messages  of  rite  most  recent  execution  of  the  model. 
Snapshot  results  files  (.SSR)  stores  the  values  of  variables  collected  from  snapshots.  The 
travel  time  files  (.TIM)  stores  aii  the  run  tiroes.  The  execution  trace  (.TRC)  stores  tire 
value  of  the  system  dock  at  the  beginning  and  the  end  of  each  executed  task.  One  of  the 
options  in  the  execution  trace  is  a  time  line  graph  which  shows  Ihe  duration  of  different 
tasks. 

The  utilities  sub-program  copies,  deletes  or  merges  the  model  fiiefs.).  It  also  has  a  facility  to 
import  data  from  an  ASCII  file. 

Additional  information  about  Micro  SAINT  is  contained  in  the  Micro  SAINT  User's  Guide 
(Archer,  Drews,  Laughery  and  Dahl,  1987). 

3.  The  Sea  hawk  Models 

The  aim  of  the  present  simulation  was  to  assess  the  workload  of  all  seven  members  of  the 
helicopter  and  shipboard  crew  in  preparing  a  Seahawk  helicopter  for  an  ASW  sortie.  Figure  I 
shows  the  model  Testseahawk"  in  which  tlx;  jobs  of  each  of  the  seven  crew  members  arc 
grouped  under  different  sub-networks  which  ate  in  turn  aii  grouped  under  network  0  which 
is  the  network  representing  the  closed  system  of  preparing  for  the  sortie. 
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The  sevc it  sab-networks  are: 

(ft)  FDMT  {  flight  deck  maimenaHce  team  -  non-aircrew) 

(b)  Pilot  (aircrew) 

(c)  Sense  (sensor  operator-  aircrew) 

(d>  Tacco  (tactical  cooniijsator  -  aircrew) 

(e)  PWO  (  piisicipai  warfare  officer  -  blip’s  crew) 

ff)  ASAC  (ami-suteiarirM  aircraft  controller  -  ship’s  crew) 

(g)  DOW  {  officer  of  the  watch  -  ship's  crew). 

The  sub- network  for  each  member  of  fire  team  ersnsists  of  ail  the  jobs  they  perform.  For 
example  the  PWOx  jobs  include  : 

(!)  read Oi’GENS (operational planning documents) 

(2)  read  the  Hy  ing  brief  details 

(3)  prepare  the  flying  brief 

(4)  attend  the  briefing. 

These  jobs  are  represented  in  a  network  diagram  hi  Figure  2. 
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figure  2.  Network  diagram  for  tbc  PWO.  The  number  at  tbe  right  of  each  nude 
identifies  a  specific  network  (rectangle)  or  task  (rouaded-comer  rectangle).  11k  title  of 
the  task  or  network  is  displayed  in  the  upper  half  of  each  node  and  the  mean  and 
standard  deviation  (min)  of  task  coojfdctioo  times  arc  displayed  in  the  lower  half. 


During  the  task  analysis  stage  of  model  development  it  was  realized  that  completion  of  some 
tasks  required  the  presence  of  two  crew  members.  Therefore  those  tasks  common  to  two 
people  iiad  to  occur  simultaneously  in  die  relevant  subnetworks.  This  was  accomplished  by 
creating  variables  in  the  variable  catalog  which  were  tiien  used  in  die  release  condition  and 
task  ending  effect  of  particular  tasks. 

For  example,  task  F4  and  task  S 9  in  Figure  1  are  the  tasks  in  wiiich  the  FDMT  ami  tite  Sense 
liaise  with  one  another.  For  this  to  occur  in  the  model,  F3  and  ,S8  each  had  in  their  task 
ending  effect  a  variable  which  changed  from  0  to  I  a!  the  completion  of  the  task.  Tasks  F4 
and  S9  had  a  release  condition  which  required  both  the  variables  in  the  ending  effect  of  F3 
and  SH  to  equal  1.  Tasks  F4  and  S 9  will  then  be  released  simultaneously  after  tire  completion 
of  F3  and  S8. 

It  was  also  apparent  during  the  task  analysis  stage  of  model  development  that  the  number  of 
jobs  performed  by  each  person  in  the  network  was  not  uniform  and  that  some  individual 
crew  members  had  a  greater  influence  on  the  amount  of  time  taken  to  complete  the  whole 
network  compared  to  other  crew  members.  This  also  meant  that  some  of  the  crew 
encountered  periods  of  time  unallocated  to  any  task  in  the  network.  However,  in  a  teal 
system,  this  time  may  be  allocated  to  other  activities  not  identified  in  the  initial  task  analysis. 
The  unallocated  time  between  two  successive  tasks  was  determined  by  variables  which 
flagged  the  end  of  one  task  and  the  beginning  of  the  next  task. 
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For  example,  the  FDMT  can  complete  siietr  first  two  tasks  kutsp&x&n tly  of  anyone  else  tout 
their  third  lask  b  to  liaise  with  the  Sense.  However  die  FDMT  cannot  perform  this  task  «wii 
the  Sense  has  completed  tasks  S2  to  SS.  Therefore  she  FDMT  has  unallocated  time  between 
tasks  F3  and  F4.  The  variaJWe/ir  leads  the  dock  when  task  F3  had  been  completed,,/)  reads 
the  dock  once  P4  had  started  mid  pirns  {unallocated  time)  was  calculated  'aomfe-ft. 

Hie  tasadoesaed  times  of  each  crew  member  were  collected  during  model  execution  and  the 
fiat  a  stored  in  snapshot  files.  Snapshot  files  were  also  created  to  accumulate  the  time  each 
member  was  busy  with  assigned  tasks. 


After  Ac  network  structure  has  been  defined  in  model  development  the  model  can  be  run 
using  model  execution.  The  mode;  was  initially  run  in  tire  debug  mode  several  times  so  that 
errors  could  be  easily  identified  and  rectified.  The  model  was  then  run  to  collect  data  and  for 
the  purposes  of  the  present  study  it  was  executed  100  times  with  a  different  seed  on  each 
iteration.  A  random  number  generator  in  Micro  SAINT  is  used  to  provide  the  seed. 

4.  Results 

Tiie  unallocated  and  busy  time  results  from  the  model  Testscahawk"  indicated  that  the  pilot, 
FDMT  and  PWO  experienced  the  longest  unallocated  times,  probably  because  all  the 
networks  started  at  the  same  time.  However,  in  a  real  system,  it  is  unlikely  that  ail  crew 
members  will  start  their  jobs  at  the  same  time.  A  second  model  was  therefore  developed 
which  incorporated  tire  tasks  performed  lyy  the  pilot,  FDMT  and  PWO  at  times  which  would 
f>e  expected  to  reduce  their  total  unallocated  lime.  Figure  3  is  a  network  diagram  of  the  new 
model  called  "Tactical"  and  shows  the  staggered  start  times  of  tire  pilot.  FDMT  and  PWO.  ft 
should  be  noted  that  the  changes  incorporated  in  tire  new  model  reflect  only  one.  possible 
solution  to  dtc  problem  of  reducing  the  unallocated  time  in  rite  model  and  are  presented  Irere 
only  to  demonstrate  die  flexibility  available  in  network  modelling  with  Micro  SAINT. 

Figures  4  and  5  show  the  unallocated  times  from  the  two  models  and  Figures  6  and  7  show 
rive  busy  times  for  each  model.  Fite  modifications  incorporated  in  the  "Tactical"  model 
reduced  the  average  unallocated  time  of  rite  FDMT,  pilot  and  PWO  by  45.4  min,  26.0  min 
and  24.0  min  respectively.  Each  average  unallocated  time  of  the  Sense,  Tacco  and  ASAC 
increased  by  only  3  min.These  increased  times  were  due  to  waiting  periods  for  other  tasks  to 
be  completed  in  the  network  by  the  crew  members  who  started  later. 

A  stepwise  regression  of  clock  time  as  a  fraction  of  die  mean  unallocated  times  of  each  crew 
member  was  conducted  separately  for  each  model.  The  resultant  equation  for  the 
“Testseahawk”  model  included  terms  fo1'  Ore  unallocated  times  of  the  FDMT,  Pilot.  Tacco. 
Senso  and  PWO.  The  equation  explained  92.0%  of  the  variance  of  clock  time  and  the 
ANOVA  for  the  model  was  significant,  /’(5,99)-22R.72,  /xO.OI.  The  equation  for  the 
"Tactical"  model  data  included  the  above  terms  except  for  FDMT  and  Pilot,  and  accounted  for 
72.0%  of  clock  time  variance,  F( 4,991“  64.2.  pKO.Ol . 

figures  6  and  7  show  that  rite  modification.,  ii  eorporated  in  the  second  model  did  not  have  an 
effect  on  busy  times  for  any  crew  merituer  This  U  ait  exfrected  result  because  the  number  of 
tasks  and  their  average  completion  times  were  >he  .same  for  each  model. 

Average  clock  times  for  the  two  models-  in  Figures  6  aid  7  are  approximately  equal,  llris  is 
probably  because  the  busy  times  of  the  Tacco  and  the  Sens.)  had  the  greatest  effect  on  total 
system  time  in  both  cases,  as  is  evident  from  the  high  correiaiioris  of  0.79  between  clock  time 
and  Tacco  busy  time  in  the  "Testseahawk"  model  (Table  1 )  and  0.80  for  the  "Tactical”  mode! 
(Table  2),  Hie  next  highest  correlations  between  clock  time  and  busy  time  are  for  the  Senso. 
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UNALLOCATED  TIME  rmn 


CLOCK  FDMT  PILOT  SENSOTACCO  PWO  ASAC 
CREW  MEMBERS 


OO  W 


Figne  4.  Means  and  standard  tfeviatiom  of  staallocaitsd  tines  S*  model 1  Tesseahawk" 
Clock  time  is  the  sitcait  donation  oi  the  whole  network. 


Figure  5  Means  and  siandaid  deviations  of  unallocated  times  for  mtxk-1  "Tactical” 
Clock  tune  is  the  mean  duration  of  die  whole  network. 


CLOCK  FDMT  PILOT  SENSO TACCO  PWO  ASAC  OOW 
CREW  MEMBERS 


Figure  6.  Mean  busy  limes  and  standard  deviations  for  model  "Testseahawk".  Clock 
time  is  the  mean  duration  of  the  whole  network. 


CRFW  MEMBERS 


hgu.  '  Mean  busy  times  and  standard  deviations  for  model  'Tactical''  Clock  time  is 
the  mean  duration  of  the  whole  network. 
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Tabic  i :  Pearson  correlation  coefficients  between  dock  time  and  busy  times  of  the  seven 
crew  members  in  the  model  "Testseahawk". 


CLOCK 

FDMT 

PILOT 

SENSO 

TACCO 

PWO 

ASAC 

FDMT 

-0.164 

PILOT 

-0.2S 

0.123 

SENSO 

0.333 

-0.029 

-0.116 

TACCO 

0,704 

-0.154 

-0.315 

0.056 

PWO 

0.01 

-0.072 

0.065 

-0.1 85 

-0.004 

ASAC 

-0.154 

-0.01 

0.107 

0.155 

-0.136 

-0.065 

oow 

-0.155 

-0.122 

0.15 

-0.058 

-0.126 

0.013 

-0.03 

Table  2.  Pearson  correlations  between  clock  time  and  busy  times  of  the  ; 
membeis  in  the  model  'Tactical". 

seven  crew 

CLOCK 

FDMT 

PILOT 

SENSO 

TACCO 

PWO 

ASAC 

FDMT 

0.026 

PILOT 

•  0.094 

-0.044 

SENSO 

0.338 

0.049 

■0.009 

TACCO 

0.801 

0.006 

-0.087 

0.033 

PWO 

0.26  6 

-0.113 

0.001 

-0.091 

0.334 

ASAC 

-0.102 

0.008 

0.063 

-0.02 

-0.171 

-0.098 

OOW 

-0. 127 

-0.132 

0.12 

-0.032 

-0.138 

0.074 

0.068 

S.  Discussion 

The  Micro  SAINT  program  has  certain  limitations  which  may  affect  the  execution  of  large 
network  models.  Although  a  network  may  comprise  up  to  4(X)  jobs  (either  sub  networks  or 
tasks)  the  job  which  executes  first  in  the  network  must  be  specified.  For  example,  the  seven 
sub  networks  in  the  "Testseahawk"  model  could  not  begin  simultaneously  at  the  stair  of  the 
network.  Instead,  the  upper  network  0  contained  a  task  start  which  had  a  mean  duration  of 
zero  and  standard  deviation  of  zero.  Its  following  tasks  statement  was  assigned  multiple  so 
that  more  than  one  task  or  network  could  begin  simultaneously  after  start’s  execution.  Zero 
duration  tasks  in  the  network  can  lie  also  used  as  a  'trigger'  for  the  snapshot  files  to  collect 
data.  (See  task  end  in  Figures  1  and  3.) 

Another  restriction  of  Micro  SAINT  is  the  limit  of  seven  following  tasks  that  can  be  entered 
into  the  modify  task  menu.  This  cart  be  a  problem  in  large  networks  where  there  are  many 
alternative  paths  through  the  model. 

At  this  stage  the  models  Testseahawk  anti  Tactical  have  no  implications  for  actual  operations 
as  there  was  insufficient  detailed  data  to  derive  a  comprehensive  task  network.  The  exercise 
reported  in  this  paper  was  to  gain  knowledge  of  the  task  description  requirements  and 
operation  of  the  Micro  SAINT  application.  It  is  planned  that  Micro  SAINT  will  be  used  to 
model  other  phases  of  an  ASW  scenario  when  data  on  task  completion  times  have  been 
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collected.  These  date  can  be  collected  either  in  an  operational  vehicle  or  a  simulator  and  will 
be  used  to  develop  a  model  of  aircrew  tasks  or  to  validate  a  model  constructed  at  an  earlier 
stage  of  system  development.  Micro  SAINT  can  also  be  used  to  predict  the  effects  of 
modified  hardware,  software  and  operator  task  procedures  on  total  system  performance. 

6.  Conclusion 

Micro  SAINT  is  an  important  analytic  tool  that  demonstrates  how  job  and  task  design 
variables  affect  system  performance.  The  simulation  technique  provides  a  method  for 
analyzing  operator  workload  and  can  indicate  the  effect  of  operator  performance  on  system 
capability.  Micro  SAINT  is  a  useful  design  and  research  tool  for  demonstrating  and 
investigating  the  impact  of  possible  modifications  of  aircrew-system  interfaces. 
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